DOCOHBKT RB80HB 



BD 098 858 



BB 006 035 



&OTHOS 
TITLE 

INSTITOTIOM 

POB DATE 
HOTE 



EDRS PRICE 
DESCRIPTORS 



ABSTRACT 



Broviif Charles I*« Ed* 

The Institutional Research Practitioner: Problems* 

Processes and Procedures. 

North Carolina Association for Institutional 

Research. 

73 

37p^ ; Papers presented at the annual seeting of the 
North Carolina Association for Institutional Research 
(firstf Charlotte, North Carolina, October 
31-No¥esber 1, 1973) 

RF-$0.75 HC-S1.85 PLUS POSTAGE 
♦Educational Needs; ^Educational Researchers; 
Employsent Opportunities; fRigher Education; 
* Institutional Research; Labor Market 



This booklet contains the proceedings of the first 
annual aeeting of the North Carolina Association for Institutional 
Research (NCAIR) . Contents include an address by the president of 
NCAIR concerning ''Changing Desands on the Institutional Research 
Practitioner**. He points out that in the relatively short life span 
of Institutional Research, several changes in desand have cose about. 
One of these changes is a coopression of tine. This address also 
contains a sumsary of the iapact of these changes on the 
institutional researcher and suggestions on how to cope with then. A 
second address, by an adsinistrator, is entitled **Nhat You Can Do For 
Os,** and suggests that professionals in the field cn institutional 
research naice a serious attempt at meaningful communication with 
faculty and administration of their institutions to clarify the 
function of institutional research. Other entries include ''abstracts 
and extracts" of workshop presentations conducted during the 2*day 
meeting. The topics covered were: research on a developmental studies 
program and its effect on student achievement, a plan for appraising 
and projecting market conditions and their influence on the 
employment opportunities for graduates of technical and vocational 
programs, a system for evaluating, teaching effectiveness, and a 
discussion concerning the implementation of the Resource Requirements 
Prediction Model 1.6 (RRPH 1.6). (HJH) 



I 

oof 

co' 

ITHE INSTITUTIONAL RESEARCH PRACTITIONER: 
PROBLEMS. PROCESSES AND PROCEDURES 

I 



us OEPAMTMENTOF HEALTH 
EOUCATION A WELFARE 
NATIONAL INSTITUTE OF 
EOUCATION 

;> » P » XAf f I Y M( C C IVE O » «OV 

•m| Pf M-.ON nM OMC.AN /A' iON OWiOiN 
• S., ? l>(^iNT 0» A OW OPINIONS 
.» AM r* [»() No' Nf < ( SSAMJl Y RE PWF 

',t N» » K Al NAf lONAl iNStitutt Of- 

» f »i * A » (IN »'os t i()N t)w POt •» y 



First Annual Meeting of the North Carolina 
Association For Institutional Research 



ERIC 



"U...'|:, v«.,...A. ..A-. HH'i ul.AMto H» 



2 

Charles I. Brown, Editor 



.N:«M. a. .mm MJN a»:msai .N 



JO 

o 

3 



PUBLICATIONS of the NORTH CAROLINA ASSOCIATION 



1973 - Inaugural Proceedings of che North Carolina Association 
for Institutional Research* 



^Requests for copies of the limited number of 1973 Prc:eedlngs still 
available should be directed to Robert M. Ussery, Director, Institu- 
tional Research, Bast Carolina University, Greenville, N. C. 27834 



North Carolina Association fos: Institutional Research 



for 

INSTITUTIONAL RESEARCH 



Proceedl.igs 



Copyright (c) 1974 by the 





ERIC 



1973 . FIRST ANNUVL MLllTINo - 1^7 S 
NORTH CAROLINA ASSOCIATION FOR INSTITUTIONAL RLSL,\RCH 



THE EXECUTIVE COMMITTEE 

Robert E, Reimarii President 
Floria R. Scott, Vice President 
Robert M. Ussery, Secretary 
S. Aaron Hyatt, Treasurer 
Edward A. Nelsen, Merober-at-Large 
Stover Dunagan, Member-at-Large 

T»£ PROGR.VM COMMITTEE 

All members of the Executive Committee 
Allen J« Darwick 
Charles I. Brown 
Ben Romine 

THE MEMBERSHIP COMMITTEE 

Charles I. Brown, Chairman 
Virginia W. Buchanan 
William M. Deloach 
Charles G. Foskey 
Robert M. Ussery, Ex Officio 

THE LOCAL ARRANGEMENTS COMMITTEE 

All Members of the Executive Committee 
Allen J. Barwick 
Charles I. Brown 
Wanda Fischer 
Ben Romine 
Satoru Tanabe 

THE NOMINATING COMMITTEE (AD HOC) 

Edwin R. Chapman, Chairman 
Lillian Y. Lehman 
John R. Meakin 
Gordon W. Robinson 
Angus Small 



THE INSTirUTIONAL RESEARCH PRACTITIONER: 
PROBLEMS 9 PROCESSES AND PROCEDURES 



TABLE OF CONTD.TS 

PAGE 

INTRODUCTION , 1 

AGENDA AND CONTRIBUTORS TO NCAIR*S 1ST ANNUAL MBETINS 4 

PPr siDENTIAL ADDRESS AND INVITED PAPERS 7 

Changing Demands and the Institutional Research Practitioner • 

Robert E. Reiman 7 

What You Can Do For Us - Charles D. Hounsheli 14 

ABSTRACTS/EXTRACTS OF WORKSHOP PRESENTATIONS 19 

itoroparative Research on Student Achieveiaent: A Developacntal 

Studies Program - Steve Lail 19 

Market Research Techniques: A Plan For A Business Community 

Survey - Elmo V. Roelser 23 

Evaluation of Teaching Effectiveness - Edward A. Nelsen • • • • 25 
InpUnenting Resource Pequirements Prediction Model l.o - 

(RRPM l.t) - James Nichols 3i Robert E. Reiman 29 

BUSINESS SESSION 30 

s 

ERIC 



INTRODUCTION 



The uonvening of the First Annual Meeting of The North Carolina 
Association tor Institutional Research at the Downtowner East in 
« h.irlotte on October 31st and November 1, 1973 turned out to be as 
mtotnative and inspirational as its planners had hoped it would be... 
I oould fay that this economy or mini-sized PRCX:EEDINGS springs from 
in ecological consciousness, using as grounds that fewer of our 
stately North Carolina pines would be needed to place it in the hands 
ot the reader, I could say that, and make absolutely no mention of the 
ai.irge to ne by the Executive Committee that NCAIR is forced by sheer 
tcononics tc husband its finances to the point of niggardliness... It 
h.id been r.y hope that an abstract of or extracts from each presentation 
would be included but faced with this sole alternative the 1973 PROCEED- 
INGS uill be limited to but a sampling of the workshop presentations... 
In ^n attempt to make up for this lack I would urge that should a 
;.arti.ular title of a workshop paper not included catch the eye and 
t tncy ot the reader that conta.'t be made with the author for a copy... 
i>ith this proposed hint as to how the reader may broaden the scope 
of their PROCEEDIt-GS, the remainder of the introductory remarks to THE 
IN>;TITUTI0NAL research practitioner:' problems, processes and PROCEDURES 
will take the form of a brief odyssey of my observations and inpressionj 
ot things heard and seen during the two-day affair. 

On Wednesday, October 31st, Halloween Day, I woke up in Fayetteville 
at f^iOO a.m. and drove all the way to Charlotte accompanied by the saae 
nagging doubt that had been with me the night and week before as to 
Whether NCAIR' s 1st rt-.uual Meetinb' would be filled to overflowing as the 
Iniugura) Program in Chapel Hill ^^rlier in the year had been or whether 
the meeting would be exclusively attended uy the FxoruUve Committee and 
to those mentioned on the Program, as it turned out I needed not to have 
worried because NCAIR' s 1st Annual Meeting had a two-day attendance of 
close to 100. The 100, or nearly so, attenders stretched from members 
ot NVAIR; to non-nembers (who were for the most part members of the 
North Carolina Association of Colleges and Universities); to observers 
iron ..eorgia, Tennessee, and West Virginia who wanted to know how to 
organize <tn institutional research association at the state level; to 
. anp followers. 

...H-er in J beyond the pre-registration figi-re of 40 given me by 
HOH 1!ssi;ky, I should recount tha? the very first real live intimation 
I had that NCAIR would do alright attendance-wise wis when I over-heard 
^"trlt'*^*''' ^'•'^ Association of Realtors was meeting on the same floor as 
V AIR) saving to another, "May, lefs not go back to onr conference, let's 

to the NCAIR instead." A moment or two later I understooa his reason 
full well, for behind onr banner and registration table was the coirely 
WASPA F ISi;ill.K... ,nd Jh veah, TANABB was there too. 

....he tirst t;,neral Session, I-.-':20 p.m., attended by an assemblage of 
-..'re than o persons v..,s tast-paced and a good om^n of things that were 
t" . o.'.,....! irst, words ut wel.or.e wert extended by the edi tor. . .Next 
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the ai{endd w.is a Uousekec>ping chore, it seems though a benaiitic 

wMen had arisen because ol a mi.splaoeil seni-volou ci two in NOAIR's 
^Viiititut ioM, however, it wasn't long bef*»re the very oap.il^lv and 
brilliant liLORlA sarrT was able to int'orn a relieved meriln*rbhip that 
the seni-colons had been placed aright and tht' semantic confusion no 
longer existed. •• lollowing lUorii to the lectern was the president of 
NCAIR, Ri^UtRT Ul.IStAN. Reina ., in my view nust be the most courageous 
practitioner of institutional research in ill of North ".^rolina and in 
a few adjoining counties of tie neighboring states, and I have no 
.]uestion but vhat you will agree with this assertion too after a reading 
ot his gutsy keynote address "CbAhfGING DEMANDS OE TW\ INSTI niTIONAI. 
RESEARCH PRACTITIONER", a pronouncement and declaration that was to set 
the tone for all ensuing acti vities. Following the conclusion of the 
first I'leneral Session, utilization was r.ade of the first i^oke and Toftee 
Break to complete checking into my room* 

•••Next on the agenda were the initial Workshops, 3-4:00 p«m«, and as an 
old 'Conference ^nd Workshop goer I naturally assumed tha; a goodly portion 
of the attendance ^ould be standing around the hall swapping stories, but 
wrong again, and again happUy so, where everybody was in the Work- 
shop ot tneir choict> listening to NORMXN Ultt. and NANCY HICK extolling 
the b'-nifits of LONI'; BAN(.-r PLANNING: MEASURIN(i INSTITUTIONAL Gi)ALS; or 
to the interesting student logs that AARON HYATT is ama'^sing for A STUDY 
OF STIjTENT OlURACTEklM lCS. 

••.Following another break for coffee, coke, or both, three workshops 
were held currently from 4:IJ - 5:15. I chose tO attend STEVE LAIL'S 
presentation on Ci)MPARATIVE RESEARCH ON STUDEffT ACHIFVEMEJfT and upon its 
completion I was prepared to swear that I had chosen the premier 
attraction, but those who had chosen to hear and question GLORIA SCOT! 
on A CASE STUDY ON INFORMATION M/\NAOEMEr!T or NANCY DECK on EfS* INSTITU- 
TIONAL RESE.ARCH PR^XIRAM FOR HIGHER EDUCATION (IRPH£) were equally lauda- 
tory of ti^e presentations they had attended* 

• ••Filled CO the brim with *"ood for thought, the next brei^k extended into 
a Social flour (5:15 - o:30 p^m.) and good use was made of this happy 
privilege to internalize the newly learned information, concepts, tech- 
niques, etc., witn several beMs of Scotch* 

• ••With the arrival of 6:30 p^m^ caiie the time to eat, thi in roduction 
of the speaker by ALLEN BARWICK and then CHARLES D. HOUNSHELL himself • 
Utilizing WliAT YOU CAN DO FOR US as the title of his address, HOUNSHELI 
lived up to every line of his billinb« l^ut now having read bot\ 'tEIMAN's 
and HOUNSHELL' S speeches sevf ral times, I an conpeiled to say r.at those 
guys are either on the sane wive length ^r ♦hat they both used the same 
speech writer^ My reasons for reaching these conclusions are that both 
after surveying the realm of institutional research found the sane short- 
:omings within the craft and both offered solutions that aie renarkabl> 
"iinilar in substance. . .The questions pofed and answers nade by HOUNSHELL, 
the anticipation of I^VJNSrll LL ' S questions and resolve*-. Hide bv REIMAN 
nake tor verv interesting ceading and hive been placed in THE PRiXTEDINGS 
back-Tc-':ack. 

...After dinner, and a jauat into tlie nav^s ot t:iiar lot for a short visit 
with ki.isner., and . t\'oiic in the on-the-prenises ni^jht clu*^ I went 
l.eddv-bve. 
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Ihursdiv. Novertb^i 1st: Cane the daw , breakfast, and the beginnint; 
a dav >t good-natured ribbing because in reportir.g the new? TODAY'S 
sni>U Vtduk Blair had said, that someone during t^e night had made off with 
a iiinetv-six pound punpkii. belonging to a farmer named Charlie Brown. 

...I would hazard the guess that the presentors of the second day of 
Workshops had taken careful note vf the benchmarks made by those who had 
preceded then and that they now had to really outdo themselves. • .And outdo 
themselves th.*v did, for example, ELMO F ^ELSER was so steeped in MhRKET 
RFSFARCH TECHNIQUES during the 9-10:00 a.m* time period that he really 
nade the sparks fly, as did EDWIN CHAPMAN a, d ROBERT REIMAN in their dis- 
cussion of FACULTY ACTIVITY ANALYSIS. Another coffee and coke break 
inpmged upon the scene followed by still another cascade of ideas irom 
EDWARD NELSON on FACULTY EVALUATION and JAMES NICHOLS on ACTIVATING RRPM-l 
from 10:15-11:15 a.m. 

...The Business or third General Session, presided over by President 
ROBERT REIMAN commenced at 11:30 a.m. and continued through 12;30 p.m. 
...As all of the foregoing meetings had been^ this oo was a beautiful 
neeting^ the major activities accomplished above the restrained comments 
ot self-congratulations and the extension of verbal accolades to a very 
cooperative membership^ were appraisals of the MEMBERSHIP and FINANCE 
of NCAIR by ROBER'" USSERY and AARON HYATT respectively; a report of the 
NOMINATION COMMITlEE chaired by EDWIN CHAPMAN; the election of NCAIR 
officers for 1974; and a number of excellent ideas by the membership as 
to how NCAIR miijht continue and €ven iniprove upon its current level of 
prosperity and influence. . .Following adjournment and a btief huddle by 
the Executive Commit tee^ NCAIR's f un-and-gtmes man^ JONES JEFFRIES^ 
ha.ided us nore than a moment of concern. 

...In narked contr?iSt to the worry lines I wore driving into Charlotte, 
on the way back tv Fayetteville it was smiles at 50 mph all the way... 
And well I might because NCAIR had just scored another coup via a 
spectrum of workshop presentations relevant to information/data manage- 
nent; institutional goals/long-range planning; student characteristics; 
Ucultv evaluation; non-f acuity work-load; developmental studies; and 
business/conununity surveys. ..and what is more the presentors of this 
array of workshops came not only from the colleges and universities but 
iron the institutes and community colleges as well. 
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NORTH CAROLINA ASSCVIATION F<>P INSTrTHTIONAL RFSI ARCH 
AGliNDA AND CONTRIUUTORS 



Date/Time 



October 31^ 1973 



10:00 AM - 
1:00 PM m 



1:00 PM 
2:30 PM 



2:30 PM - 
3:00 PM - 



3:00 PM 
4:00 PM 



(Two Concurrent Sessions) 



4:00 PM - 
4:15 PM - 



4:15 PM 
5:15 PM 



Second rioor 

Rooms 202, 204, 
206, 208 



Activity Place 

Registration 

General Session 

Welcome 
C'larles I. Drown, 
layetteville State University 

Ratification of Constitution 
Gloria Scott , 
N.C. A&T State University 

"Changing Demands on the IR 
Practitioner" 
Robert Reiman, 

Appalachian State University 
Break 

Workshop lA 202, 204 

"Long-Range Planning: Measuring 
Institutional Goals", 
Norman Uhl, N.C. Central Univ., 
and Nancy Beck, Educational 
Testing Service 



Workshop IB 



206, 208 



*A Study of Student Characteristics", 
Aaron Hyatt 

Western Carolina University 



Break 

Workshop 2A 

"A Case Study on Information 
Mana^^ement", 
Gloria Scott 

N.C, A8cT State University 



202, 204 



(Three Concurrent Sessions) 



Workshop 2B 



206 



"Comparative Researcn on Student 
Achie«ment", 
Steve Lail, 

Catawba Valley Technical Inst* ute 
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Agenda for Annual Meeting (Continued) 



Date/Time 



5:15 PM - 5:45 PM 
:^:45 PM - 6:30 PM 
6:30 PM - 



Agtivitv 
Workshop 2C 

InforiQAtion Pertinent to ETS*s 
Institutional Research Program 



208 



for Higher Bducatioi^ IRPW] 
Break 

Social Hour 

Dinner Meeting 

Introduction of Speaker: 
Allen Barwick, University 
of North CArolina-General 
Administration 



Marco Polo C 
Marco Polo C 



Address: "What You Can Do For Us I" 
Dr. Charles D. Hounshell 
Vice-chancellor for Administration 
University of North Carolina at 
Greensboro 



November 1> ig73 

9:00 AM - 10:00 AM 



(Two Concurrent Sessions) 



10:00 AM . 10:15 AM 
10;I5 AM - 1:15 AM 

(Two Concurrent Sessions) 




202, 204 



Workshop 3A 

"Faculty Activity Analyses'\ 
Edwin Chapman^ Western Piedmont 
Community College; 
Robert Reiman^ ASU 



Workshop 3D 2O6, 208 

"Market Research Techniques'^ 
Elmo Roelser^ Appalachian 
Special Development Consortium 

Break 

Workshop 4A 



202t 204 



"Faculty Bvalua^ion"^ 
Ed Nelson 

North Carolina Central University 



Workshop 4B 

"Activating RRPM-rv« 
James Nichols 
Coiword College (W. Va.) 



206, 208 
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Agenda for Annual Meeting (Continued) 

Pate/Time Activity Place 

Noveraber 1> 19? 3 
11:15 AM « 11:30 AM Break 

11:30 AM - 12:30 PM Business 5;ession 202, 204, 206, 

208 

Membership Report (Ussery) 
Budget Report (Hyatt) 
Llection of Officers (Ch^^pman) 
Other Business 
Adjourn 
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PRESIOEKTIAL AOORfiSS AND INVITED PAPERS 
****** 

CHANSXNG DEMANDS ON THE INSTXmXONAL 
RESEARCH PRACTnXONBR 

Robert E. RciMtn 
Appalachian Statt Univtraity 
It acems a little incongruoua to apeak about change in a profeaaionU 
field that ia aa new aa inatitutional reaearch, and, further, it aay cee« 
absolutely blasphemous that one auch aa I, who has only V:ioim about inatitu- 
tional research for a little «>re than a decade, should have the effrontery 
to suggest that very »ich change ia indeed occurring. Nevertheleaa, I have 
already observed conaiderable change, particularly «• it deala with deMada 
being levied directly on the practitioner. 

Frankly. I can find little documentation to atmport my reMrka. The 
literature of institutional research it sparse to begin witht .oat of ahat 
has been published ^s contained within about ten voiUMS of procMdlaga 
of the an.iual foruma of the Aasociation for Inatitutional Reaearch, and, 
noreover, consists nainly of reporta of reaearch findings. In browaluf 
through the relatively aeagre aupply of information that remains, I do find 
two things that have not changed: (1) the basic definitions of the pur- 
poses and goals of institutional reaearch, and (2) the continuing contro. 
versy as to the definition of the role and atatus of the inatitutionU 
researcher. 

It seems to me that Hugh Stickler»a ciasaic definition, forailated 
in 1959. was sufficiently comprehensive to withstand change. According 
to Stickler: 1 

Institutional research refers to research which is directed 
toward providing data useful or uecessary in the making of 
intelligent administrative decisions and/or for the aucceasful 
maintenance, operation, and/or improvement of a given inatitution 
of higher education, it includea the ccllectiou of and analysis 
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of data used in appraising the environment or '"setting" in 
which the institution operates, in preparing the budget, in 
planning new buildings, in assigning sp«ue in existing 
buildings, in determining faculty loads, in admitting students, 
in individualizing instruction, in planning the educational 
program, and the like. It is needed to tacilitate efficient 
operation, but is also needed to promote qualitative improve- 
ments. 

This seems to describe fairly well the ends that most of us were, and 
still are, trying to seek. However, I see Stickler's purposes con- 
siderably expanded and I see considerable differences in the means 
through which we seek those ends. 

In December of this year I will complete my seventh whole year as 
a practitioner of institutional research. (I might add that our 
national association has been formally organized just about that same 
length of time.) Like some of you, I had little formal training that 
could be even remotely related to institutional research; I was quite 
hot on the philosophy of higher education, but stone cold on the methodo- 
logy and techniques of any kind of educational resea h. 

Notwithstanding these personal weaknesses, I started out, in 1966, 
to do all of the things I have just read from Stickler's statement. 
Because of the little I knew of the ways of the profession, I wrote to 
many of the "front-runners" in institutional research and asked them how 
I should go about doing these things. As is typical of the breed, I was 
innundated with advice! For this advice I was very grateful, because, as 
some of you may remember, we were just then becinning work on the first 
state-wide long-range plan tor higher education. 

My first task, in the overall endeavors of long-range planning, was 
to produce an enrollment projection, so I borrowed my methodology from an 
eminent practitioner of the upper midwest United States. His technique 
was sufficiently oonplex and rigorous, and was representative of most 
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projection methodology of the time; ny administrator colleagues could not 
drgue over it— they could not even understand iti It was, however, 
respectfully admired within the field; yet it was hard to believe that 
the figures it yielded Could be so unreliable I Now, only seven short 
years i.tter, no one in his right mind would try to project enrollment 
using the scheme that I tried to use then, because it was based solely 
on historical experience. As you know, that approach which, in many other 
instances as well, damaged our credibility soaewhat during the sixties is 
even less acceptable today. We havt come to recognize that quite often 
the only reliable historical information that we possess is what happened 
last jrear. So, we accept this premise and build out predictions based on 
sets of assumptions, rather than depending on experiences. 

This is where, as I see it, monumental changes in demand are coalng 
about. No longer do we have the option of formulating^ strategy or com- 
piling a plan for institutional change. Instead, we are called upon to 
present, in advance, a list, or lists, of all the vi«>le alternatives that 
may accrue as a result of a particular decision or course of action. Pro- 
ducing these alternatives requires the use of some unproven techniques. 
I djn speaking, I guess, of something often referred to as simulation 
modeling. Because "quantifiers" have not yet come up with models that 
present us with optimum solutions, we are forced to plan the "if-what" fame 
(i.e., if a certain course of action is taken, what will be the outcome?) 
This is all HeLl and good, but we sometimes find that the list of alterna* 
tives is so long that we need another model to explain the alternatives 
to tlic .ilternaiivesi 

That leails to tae next, and to me the most frightening, change in 
denu.d— that is, the compression of time . Way back when I started out 
(renenber, it was a whole seven years ago) we would sit down and brain- 
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Storn ;i proposed studvy review the pertinent literature, formulate our 
research design, develop specific instrumentSp collect the data, analyze 
it^ write the report, send copies to everyone, receive .1 tew plaudits 
and a little criticism, and then tool up for the noxt iteration of the 
study. This process usually took from several months to sometimes a year, 
depending upon the nature and complexity of the investigation. True, we 
sometimes had several of these going simultaneously, but the whole process 
was terribly time consuming. No morel In the first place, studies 
pursued in the manner I have just mentioned usually turned out to be 
pretty bland» Wo oUen discovered from them facts that we already knew, 
or at least su:>pected» Secondly, no modern-day administrator wants to 
think ahead that far or wait that long for hard data upon which to base a 
decision. His world is continually in crisis (it has been said that crisis 
is currently the normal state of events in higher education) and crises 
must, of necessity, be dealt with swiftly. So, today we are faced with 
the need for not only a well stocked **data-bank,** but for a **solut ion-* 
bank** from which the institutional research practitioner will be able to 
draw innediately the alternatives that might accompany almost any course 
of action* 

This reinforces further another demand, one which I have labeled, for 
want of a bettei tern, **instant institutional research.** We live in an 
**instant** age: instant grits, instant credit, instant-on television, etc. 
Our *'customer s'* demand **instant information.** Only a few weeks ago I was 
called upon to produce a computerized model to answer the question: What 
would be the faculty promotion and tenure situation in our institution in 
five or ten years if we did, in fact, reach steady-state conditions of 
financial suppori? Ine chairperson of the committee requesting the mani- 
pulation expected her answers wx'^rin the week and was somewhat miffed when 

> 15 
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I stdtea that it night take me at least weeks to effect such a modell 
As a natter of fact, I have not managed to assemble the model yet, but I 
an working on it I 

••I an working on it**~those words sun up the confusing state of affal 
at the mo-nent. We cannot get help from the literature, because there is 
not any— we are all too busy to share our works through publication. If 
you have browsed lately through the ERIC indexes you see little or nothing 
listed under the heading of institutional research. In the last index I 
looked at even the subject heading was missing I This surely is a deplor- 
able state of affairs, but one to which I am a party— I have not had time 
to submit anything to ERIC in the past eighteen months. 

Another facet of changing demand has to do with our ability to 

determine more succinctly just where we fit in the input-output process. 

Are we processors of data or are we facilitators of change? This is a 

weighty question, and it staggers me, but I feel more concerned about it 

daily. Measuring inputs and engaging in processes at one time seemed to 

me to be the role of the institutional research practitioner. But now I 

think that only lead'j to what Suslow was referring to when he said:^ 

Regardless of the organization of the institutional research 
program ac any institution, there will be limited resources, 
both of staff and expendable funds. To conserve its energies^ 
institutional research should not perform the functions of 
generator or naintainer of routine and extensive data files, 
but should be involved in the initial description of data and 
monitoring their quality, validity, and reliability. Institu- 
tional research should participate in the development and 
monitoring of the institi * ion» s management information, but 
It should not be calico upon to maintain any information 
system on a day-to-day basis nor should it be asked to ma lage 
the computer facility or facilities associated with any system. 
These functions are necessary and they require trained staff, 
but thev are the processes, not the products, of information. 
The linited resources of any institutional research effort can 
be rapidly dissinated if that effort becomes burdened with 
repetitive, routine data collection and large systems main- 
tenance. If these functions are called institutional research, 
thev are incorrectly named. 

» 'U16 
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We need to copy this portion of Suslow's declaration on institutional 
research underline some of it, and send it to our imnediate supervisors! 
The fact is, we still need to measure input and we still need to be 
involved in processes~but these must be routinized, mechanized, and 
speeded up so that our real function is to act as the catalyst in the 
formulation of alternative actions. And, most important of all-«we need 
to reach out into that never-never world of discovering what the real 
product of higher education actually is. By that I mean we have got to 
get a better handle on outcomes, if we are to improve higher education. 

Another change that I have observed is the growing tendency to 
utilize the process and products of those other manipulators quanti« 
tative data within the institution. Because of some of their efforts, 
we are in the midst of an *'output glut." Administrators have finally 
discovered the computer and are no longer frightened by its threats to 
disclose all. They demand reams of data. As an illustration: Five 
years ago no one at my institution was terribly concerned about the kinds 
or grades being awarded to students by faculty members. My office pro- 
duced quarterly a routine study (which no one looked at) which ran to 
some 15 or 20 typewritten pages of summary analyses. Today, with every- 
one concerned about the disparity of grading practices, our administrators 
demand the production of analyses that run between 300 and 400 pages— 
so much that no one is able to digest the results* This leads me to worry 
about the fact that as our capability to produce output increases, our 
time and abii.ity to interpret data decreases* This increase-decrease 
phenomenon appears to be expanding at an exponential rate. 

To summarize briefly the inpact of the changes in demands that I see 
being imposed upon the institutional researcher: (1) I no longer an 
afforded the lead time to produce research of an esoteric nature; I must 
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find ways to retain the ^luality but greatly speed the process; (2) my 
custoners (administrators and/or committee chairpersons) no longer seek 
my philosophical advice-«they only want to see it in a print^out; (3) no 
one knows how to read my "new" evidence (that which deals with simulacion), 
I need to take time out to educate ray clientele; (4) I need to work more 
closely with my colleagues w;io process my data, so that their output is 
more easily understood by all of us; (5) I need to worry less about 
information that I do not have and get to work forging better linksge 
nechanisBs for utilizing the data I alresdy hsve; and (6) I need to quit 
griping about the confusion that I face dtily and spend more tioe sharing 
ny meagre store of techniques and procedures with my counteipsrta, wherever 
and whomever they night be. 

The last item is, to me, the most important one. There's no time left 
to re-invent the wheel! I hope that is what our new association is all 
about. 



1 W. Hugh Stickler, "The Role of Institutional Research ii 'The 
Managerial Revolution in Higher Education.* An overview,** in W. Hugh 
Stickler (ed). Introduc tory Papers on Institutional Research, Atlanta, 
Southern Regional Education Board, 1968, p. 3. 

2 Sidney Suslow, A Declaration on Institutional Research . The 
Association for Institutional Research, 1972, p. 7. 
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WlLVr YOU 0\\ LH) I OR US 
by 

i.:harles D. Ilounshell 
Vice Chancellor for AdnMiistratioti 
University of Worth Carolina at vSreensboro 

It has become a cliche to say that there is a need lot more efficient 
and nore et't'ective nrnagenent in colleges and Uiiiversities: 

It is necessitated by spiraling enrollnentp spiralini; costs, followed 
by stabilised enrollner.ts and competing demands for resources* 

li is required by demands for accoutUabili ty : what are we doing? 
For whom? At what cost? io what effect? 

It is epitomized by necessity tor plai:ning« We need to know where 
we are, whete we want to go, how we propose to get tliore and when* These 
questions wil.l get answered, either by institutions ot higher education 
themselves or bv those to whom such institutions are accountable. It is 
a paradox that educational institutions, presumably citadels ot' rationality, 
should not be in the vanguard in planning - in applving reason to the 
shaping ot their owr. destinies. Iiwreasingly, however, we are coming to 
the realization that it' we do not do our own planning someone else will 
do it for as. 

In the development of more efficient and more effective management 
systems, and in the development ot planning proct?tluies, tliose ot' you who 
are memt:ers of the new academic discipline of institutional research 
must plan a lea ng role. 

Mr. Earl Cheit, in an address before the .Xnerican v'ouncil on Iduca* 
tion, raises the .]uestion as to whether we can be bi>th sy«5temalic and 
academic. Mr. James Kellv, in response, savs Uiat ttie real .juestion is 
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wru*t!-.cr the a*/ailvniv: connunity can accomnudate a new disciplin<' - the 
nanu,;enent s« Htens 'ii..il*st - in its midst. I would smuggest th<:t it is 
prol V.'le tiiAt tho acudenic conununity cannot survive if we cannot develop 
nore eKfe«:tive and more efficient nanagement techniques. 

Ahat can yoa do for us in this situation? You can educate us con* 
jorning what you ran do for us. 

1. specially, for this audience one needs to define his terms or 
Ctitei^ories. 

L3y '*You'* I mean the nenbers of the new academic discipline of 
Institutional Research - the specialists.^ professionals^ producers. 

By *'Us" I mean the faculty and especially the adAiinistration - the 
^erier<ilist Sy l<iynen, consumers. 

lot nv purposes this evening^ permit me to place myself in the 
category "Us", aid to place you in the category *'You*'. As the one to be 
educated 'y you, I would like to relate some of my own general attitudes 
towards inr'ti tutio ;al research and my understanding of what constitutes 
the tttnc:tion of institutional research. 1 justify this parading of oy 
ovsri prejudices uid understandings * or misunderstandings - on the grounds 
that it nay be typical of many of the professors and administrators who 
need to be educated corc»'.ning institutional research. It iSt of courf^e^ 
.i naxin of i;cod teaching that you start at the level of your studi>nts. 
My >wti experience and thoughts may give you an indication of the level 
of those whon you should educate, and the magnitude of the educational 
t I sk that lies ^liead of you. 

Vsithout attenptiag to be exhaustive I would like to list a number 
.)t cnti al attitudes (prejudices) concerning Institutional Research that 
I have ikJ^^o^ed • ..t least fleetingly - at one time or another in my 
experience. I suipect there are professors and administrators who still 




holJ theie attitudes. 

!• Institutional 'tesear^h is window diessiiii^ (or dei isions nade 
indepet dentiv of the data. Perhaps all of us could citr cxanpl^s wh^rre 
this was or at least appears to be the case. I recall .i decision in one 
institution to suspend or terminate certain programs wtiere decision was 
justified on the tasis or a jost analvsis that was made subsequent to what 
was in ia:t the decision. 

2. The institutional researcher imposes his valuer on the data. 
Some vears ago I knew of a researcher who found 'Jiat the freshman grade 
average did not increase as the lualitv of ',he enterin,; freshmen improved 
(as measured bv high school iJFA and scores on SAT), and he concluded that 
the faculty was not responsive to change in quality of studencs; that the 
faculty maintained traditional grade curve and that this was undesirable 
in view of the improved quality of the studtnts. Clearly his conclusion 
reflected a value judgment that the expectations on the part j( the pro- 
fessor should have remained static. 

3. Institutional researchers jre preoccupied with methodology, they 
talk among tht^nselves in their own language, and tfiey are unable to 
communicate neaiiingf ullv with others. The fact that ifie same criticism 
could be levelled at their own disciplines does not preclude such views 

•/ bv members of faculties. 

4. Institutional Mesearch is a necessary evil, a weapon to be 
mastered for one's own purposes. Some educator^ have expres'jed the view 
that the development of offices of IR and MIS ate inevitable, so lev's 
adopt the strategy of the Saxons - let's learn to -.peak Irench better 
than the Normans. Let's beat the quantifiers and the systemalizers .it 
their own game. 



5. Finally, there is the rather pervasive feeling tli.il nucfi that 





cones uptler the label of IR constitutes a threat traditional academic 
values: a fear that data will be substituted for judgment^ that creativity 
in progran development will be hampered if not stifled by reporting forms 
and cost analyses, that quantification will supplant qualification. 

As I said, these are views that I have harbored • at least fleetingly « 
at one time or another. They are views held still by a sufficient number 
of "us*' that they should be taken into account in your task of educating 
us as to wnat you can do for us« 

At the level of my present experience and understanding^ I would list 
the functions of institutional research as follows: 

1« Develop and maintain central data sources for reporting and for 
analytical and evaluative purposes. The Director of Institutional 
Research should be the person with the greatest knowledge of available 
data sources in the institution and should be responsible for responding 
CO special and routine requests for information^ such as HCHBD and HBGIS« 
He should also ascertain the types of data desired by the principal 
administrative officers and the data that may be needed for answering 
questions that should be asked about students^ the curriculufflt faculty^ 
administration policies, financial resources, ?.nd physical plant* Pro- 
cedures for collecting pertinent data on a xoutine basis should be estate 
liJhed and provision made to assure that in*put to the information system 
would be retrievable in an efficient manner* 

2. T'evelop instruments for planning purposes* Operational as well 
as analytic and evaluative data provide the in-put for the development 
of a planning capability through utilization of a number of NCHEMS pro« 
ducts* The Director of Institutional Research should play a major role 
in developing, testing, implementing, and evaluating such instruments 
as the ICLM ana RRPM« These atf potentially valuable as internal planning 



ERIC 




tools and for the production of information which would not otherwise 
be readilv obtainulU. The Director c! Insiitutional Research should 
have the responsibility of testing such nodels and ot advising the 
principal administrators concerning their usefulness and concerning 
the effects of altering various parameters. 

Serve as resource person. The Director ot Institutional 
Research should be able to assist otherr. by raising v^uestions anu 
suggesting appropriate data sources which would aid in stimulating the 
deVilopnent of studies of individual departments, programs, or operations, 
n the Director is taniliar with a wide range ct' institutional, state, 
regional, or national information sources, he can be of great assist- 
ance to individual tacultv nemberi>, faculty committees, or administrators. 
He should act as a channel of information to interested persons and 
should be able to point to particular problem are-^s as well as anticipate 
the types of problems which night develop. 

In nv view, the role of institutional research in the future of 
higher education is central. There is no reason for incompatibility 
between efforts to manage our institutions in a rational, systematic 
manner on the one hand and the preservation of the ossential, desirable 
characteristics ot acadenic institutions on the other hand. Indeed, it 
IS r.ost likelv taat the latter can be maintained and preserved only if 
the former is undertaken, 

I would urge vou as prot essionals in institutional research to 
enter into dialogue with the faculty and administration of your institution 
concernint: the function of institutional research. I v,ould invite you to 
educate us vori/erair.g what vou can do for us. 
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Ab>lRACr>/tXTKA(TS OF WORKSHOP PRESENTATIONS 
****** 

COMPARATIVE RESEARCH ON STUDENT AailEVBMEWT: 
A DEVELOPMENTAL STUDIES PROGRAM 

Steve Lail 

Catawby Valley Technical Institute 

In the Fall ijuarter, 107?, Catawby Valley Technical Institute iB«>le- 
nented a pilot Developmental Studies Prograa in the business curriculum 
utilizing tour courses: English Graomarp Reading CoiDprehenslun» Business 
Mathematics and Introduction to Business. The initial program has been 
restricted to a limited number of courses in the business area in an 
effort to closely control all variables possible so that a viable com- 
parison can be made between the progress of the developmental students 
and traditional curriculum students taking the same courses. 

The objectives and the credit hours for the developmental courses 
are identical to the traditional courses. The primary differences are 
in the teaching techniques being used and the time limit allowed for 
completion of the material. The program is designed to give the student 
all the time and personal instruction necessary for him to complete his 
courses successfully. This is achieved by dividing the courses into 
small units with a specific set of tasks to be acconplished in each* 
The student works through each unit at his own pace coiq>leting one before 
beginning another. Upon entering class the student takes an Inventory 
test which surveys his general knowledge of the material to be covered. 
The instructor can then determine exactly where in the course the student 
needs to begin. This eliminates starting the student into material with 
which he is already familiar and also helps insure against starting him 
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into advanced material for which he is not yet prepared. 

i'.ach course is based upon measurable objectives that inform the 
student exactly what he can expect to learn and precisely v;hat he must 
do to receive each grade. The student is informed of the minimum number 
of objectives that must be accomplished for each respective grade of 
"B" and "C". All tests must be passed av the 80% level which is a minimum 
grade of "C". If the student falls below the 80% proficiency level he is 
required to re-study the material on which he missed the questions and re- 
take the test a short time later. 

Since lack of motivation is an ever present problem with the under- 
achiever, we have eliminated the grades of "D'» and "F" in this program as 
an added incentive. It is not only our purpose to give better instruction, 
but also to build self confidence in the student so that he may be more 
fully aware of his capabilities. If the student has not successfully com- 
pleted at least the minimum number of objectives for a grade of "C'» by the 
end of the quarter, he will receive a grade of "Inconplete", register for 
the next quarter and take whatever additional time necessary to complete 
the developmental course(s). 

Students were selected for the program on the basis of general 
aptitude scores using the General Aptitude Test Battery. We conducted 
a regression analysis on the aptitude scores of all incoming freshman, 
predicting the degree of scholastic success these students would achieve 
while at CVTI, then selected 30 people with the lowest scores to enter 
the program. Among the 30 students that entered the program 18 completed 
their courses during ihe tirst quarter, 2 second .juarter, leaving 
only 2 students in developmental courses during the third quarter. The 
retention rate in the developmental progran was 100^* for the fall quarter, 
^3*tf for the winter and spring sessions in which two students dropped out 
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of school for personal reasons. 

Although the students chosen for the developmental program had 
significantly lower G.A.T.B, scores than the average student, their 
final course gt»des reflected no significant difference from that of 
the general student population taking the same courses under traditional 
instruction. This fact alone seems to indicate that given enough time 
and individualized instruction, the underachieving student can successfully 
complete college level work. 

The materials used in these classes were designed and developed 
during the 1971-72 school year by the instructors teaching the courses. 
The continuous revision and updating of these courses after each quarter 
helps insure that the students achieve optimum results. In addition, 
consortium funding has enabled us to purchase study carrels equipped with 
slide projectors, tape recorders, and headsets. Through the use of this 
equipment we have the capabilities to supplement the student's instruction 
With relevant audio-visual materials. 

Although final evaluation of the pilot program is no» yet co^leted, 
preliminary results show a high degree of success. Based on these earlr 
indications, it is our bel'.ef that the program will prove to be invaluable 
means with which to aid the underachieving student. 

In addition to the continued administration, evaluation, and eipuwion 
of the Developmental Studies Program the coming year will be devoted to 
the research and development of a Business and Industry Survey for the 
surrounding area in an effort to insure that the institute's offerings 
are compatible with the community's educational needs. 

»>veraU, the initiation of this year's activities have to be con- 
sidered a total success. This positive beginning coupled with the expect, 
ation of increased fundina«n|yt year will enable us to continue to find 
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methods of providing the best educational opportunities possible for all 
people. 
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MXHKl.i Ri:Sl:ARCII TECHNIQUES: A PLAN FOR A 
llUSINESS COMMUNITY SURVEY 

Elmo V. Roelser 

Appalachian I'cveloping Institutions Consortium 

The ideas and techniques presented in this talk have grown out of 
ef torts by personnel in the Department oi Community Colleges to appraise 
and project job market conditions that will influence the employment 
opportunities for graduates of technical and vocational programs. 

The preparer of this talk has had the benefit of ideas and techni* 
%4ues developed by the ~ 

Research Coordinators^ Appalaohian Developing Institutions Con» 
sortium Occupational Information Center^ with its Directing Staffs 
Mr. Marcus Allred^ General Harvey Fischer (retired)^ and Ms. 
Christine F. Myers 

The applied research activities of personnel in these organizations 
has centered on developing high school student surveys^ alumni and 
attrition follow-up studies and business*conmunity surveys all within 
a projected Management Information System. 

RATIONALE FOR THE STUDY 

While the 1970 Census data are available in many state and federal 
publicationst these data lack the specificity required for planning in 
the one^ two, or three county community college/technical institute 
serviCif areas. The problem vith utiH?ing data from a publication such 
as the General Social and Economic Characteristics! North Carolina* a 
document from the U.S. Department of Commerce^ is (1) that the statistics 
are not printed if their disclosure would reflect upon individual firms 
and (2) that the details on numbers of persons employed in certain 
occupations are not classified by the occupational titles necessary for 
planning at the institutional level. 

After reviewing the statistical materials available thoough state 
and federal agencies^ it was determined that the institutional program 
planning data could only be acquired by conducting a business-community 
survey. For this reason the study seemed to be Justified. 

PURPOSES OF THE STUDY 
The Business-community Survey^ .laa iWO purposes! 

To gather information that will facilitate five*year projections 
of all number and types of Jobs that will be available in the 
institutional service area ~ jobs for which the community 
college or technical institute can pKivide training. 

To provide a direct personal communication link between enplo/* 
ing organizations in the area and the local two«year institution 
so that information about community needs and community college/ 
t?chnical institute capabili'jies can be exchanged. 
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To accomplish the purpose of th.- study, it is .u.t i( ipated that the 
analyses ot the busuiess-tonnuni ty survey data will i.ulude the < onpari- 
son ot th.- numter ot students selecting particular education-training 
S!^Sirr.'"<J j?%""f" graduates ar.d liLMS (liarU Leavers with 
Marketab e skills) of curricular programs; and then these two numerical 
Items will be contrasted with the d-nands ot the job market. 
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EVALUAriON ()F TEACHING EFFECTIVENESS 



Edward A. Nelsen 



North Carolina Central University 



As an institution which serves substantial numbers of disadvantaged 
and educdtionally handicapped students^ NCCU can help its students 
achieve their full intellectual potential and personal maturity only 
it it maintains a highly capable and dedicated teaching staff* Although 
some pessimists have claimed that (individual) **teachers are born^ not 
made,** establishment and maintainance of high caliber teaching staff 
will not result from chance. To fully meet its obligation to its stud- 
ents, Ni'CU must strive to acquire^ support^ and retain effective teachers* 

Among the various procedures an institution can use to establish and 
maintain excellent teaching, perhaps none is more basic than an evaluation 
system* A system for evaluating teaching effectiveness could potentially 
aid and improve the teaching«learning process in multiple ways^ for 



— instructor evaluation and rating scales can help define and 
clarify personal attributes which are related to successful 
teaching; 

—evaluation data can serve as feedback to inform instructors 
concerning their impact on students and to suggest means for 
improving teaching; 

—evaluation techniques can be designed to bring about specific 
cation of teaching objectives; 

—evaluation data can provide administrators with an objective 
basis for rewarding effective teachers with promotions and/or 
merit pay increments; 

"-course evaluation data can provide students with information 
concerning characteristics of courses and instructors^ which 
in turn could better enable them to select courses which 
would fulfill their needs and expectations. 

In view of these potential benefits from a teaching evaluation ^vstem^ 
it is not surprising that numerous efforts have been made by faculty 
conmittees, studitnt committees^ and administrators to initiate evaluation 
procedures at NCCU, as well as other institutions. Indeed^ many would 
consider some sort of evaluation system a necessity. ThuSf it is all the 
nore perplexing that faculty members^ administrators^ and students have 
been unable to agree upon instruments^ procedures^ and policies for 
evaluating teaching. This perplexity is shared^ moreovett by faculty^ 
students, and administrators at many other colleges and universitiest 
which likewise have been unable to implement evaluation procedures which 
were tyand-large satisfactory for all concerned parties. 
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pri* filuif. . II) pt»ili.i|.s tf^t t '.iiulfrst«u)»i .1^ ifultMif; t r. n Uw •.ht»fi 
-:.>r:plr\i t , x\.v ismi,... .m.! [»r.»! l.-ns i::v.ilvr.i m tin- rv.ilu.it i..n v»r 
ttM.hiM^; fttr tiVf'iiess. IiKltMNl, l»Mi»n» I sN tf.'Mti. nr.u r'.J'iif t.»i 
evalu.itir;|5 toi.t:iiij; v .ui »r • u. . fssi ul I v inp lei-iMr^l ..n .m i nst i tut mii- 
wide \ tlu»*;»' i-.vvii's .iiul pi.'Mi»ri>i rui^t > »• if .^giii/fj i «••..»! Vfd 

to tht» Sit I s: a.- 1 i»i ptm.*?:^ atle.ted f". the- pi...fs., i :i' l-.uli ii^: 
student t 4iult\ nt-ntfi s, uid .tdniiiist r.itoi s. 

Fiist, tht»rr Is the tund.inerUil jiu'stiMji .»iu f»i tn ii^; t lir pin p.)so.< 
.md i.Me/:ive!> lindt-r l. in^ tlu* t-v.i I u.it i on. K.iif»lv li.ivf tin* ditfort-nt 
parties agreed upon .1 p.«r t ivul.ir purp.jse or pnrposf^ for .1 system, and 
each p.irtv nit;ht exper t the results .ui fv.i I ii.it 1011 procedure tt> serve 
his own purposes. l-or I'X.inple, .111 in^t ru.* t or nifctlit wisli t.>i I eedlMt k 
concerning his impact vu students and I ^r other iiu orn.it ion whuh could 
enable hin to improve his teaching el t e.. 1 1 vrnes^; .m administrator mi^;ht 
desire objective data he -ould use m rew.irdint; t»tlective teathers with 
promotions and/or merit pay increneiits; and students mi^iht bv primarily 
concerned with iiitormation whu h . ould l»etter eij.ihle the:n to >.elf«.t 
courses and instructors who would meet th*:ir net»ds .md expe« t .it ions. 

However, in a tual attempts to rt'le.t or de.:ij;n d.ita ^jalheriiiu instru- 
nent(s) and t.- inplenent adr.i ni -a rat 1..1;, s- .Mi::,;, and reporting; procedures, 
these various purposes .uid ot jf*. tives nav re.idil*. .*omf into ront li< t with 
one another. lor example, fValuit ion ! or < oui -^i improvement should con- 
sider various a*-pect.s 01 a « oiirst*, iiu ludiiu; th»' texit ook, pace and ditt'i- 
cultv level id the cours»., .la-s si;se, lat'oratory ♦•xer.ises .uid facilities, 
course o^ ler. 1 1 ve*., subtlest ions f cr inprovemeni , et. . «»n tht- oth«'r hand, 
evdluatior: tor promotior. and/or nerii-pav i nc r«'n« iit s shi»nld be conct»rned 
primarily with those aspe, ot a course th.it .ire dire-. ilv under thf con- 
trol oi an individual 1 ns t r ac tor , e.^;. tht» <|Ualitv 01 lt»itures, the 
instructor's preparedne-.s, his . on.-t»rii lor students' pro^iress, «'t<. 
Furthermore, an evaluation r»ro.:ednre . t>n. criiivl ^iih our-^»« improvement 
night t-e open-ended, sul'iective, and primarily concerned with .jualiiative 
issues. Hv contrast, 1 pr-'M-dure i-oiu.erued with r.iti'^^:. for pav .nut pro- 
"iot'-ons should t-e ^tiu-luied ( r. t aiidardi /ed ) , ..Iierlive, and ul I 1 rut I v 
.quantitative. It is al... p..s^ii>lr that stude nt or oth- r r. iters would 
respond di l teren 1 1 •. to ^iver: in^t rui-i'-nt it wert» aw.ir** oi the nislru- 

nents weie ti» l«e u>-ed ti»r one purpose versus aiiotht-r. 

St it;d in i:s)ther wa, , it the primarv purp"- r ot fValu.ition 1. . tjuise 
impr. vemeru rather thaji ^ .M-ipa r i soti amonj; dilt»rent i iist ru. t«u s, then 
"popular I tv hilo ette.'t, in.l other rater iM.t-in^; t.i- tor- are relatively 
uninportiar, and .ubie. tive viewpoints and sn^^,-. 1 1 ..ns on an i>peii-ended 
instrument 'r\ individuil -students n.iv he ver . hflplnl. IW contrast, it 
the prinarv pjrpo^e ot ev.iluation is to dt-ttMninf pr* ..-not 1 ons, then issnt-s 
such .IS obie. tivit^, I'aant 1 1 at 1 ve wi-i^htin^ s. hfi\e-, p.»-^iblf rat^r bi.i-,es, 
St andardi..ai ion ot the instrument and procedures, autonaiion ot iwii'" 
procedures, ..osi idr.i ni .t r.il 1 on, prot.eilnres r.«i rep^^rtin^; dat.i, ft . 
become parar.».»u: f ind pr.«Mf jai ir.il , 

In si:r^, it . le.ir thit ti.e c t»nt r.i^t : iic puip«ist»v n:id»* r I v i n^: evalua* 
tiv»n~i^:::t Ifid t^ i»:itli ti.u; pio rdur.* i • : d .Mind«-.I result-.. It 

sl....iLl S« re .>g:-.i/rd 'i-.l it is pro»aMv i:\pov. i • f h'Vtlop a •.i!i^;l«- 
instrur:rnt or pro. etlur«» w!:i.I: .at i st a* t .»r 1 1 •. N,.rvrd ill ot tlie purposes 
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di«^ =:^>eil ;i^ovt«. Thus, .npleneiitdt ion of an evaluation system at NCCUt 
It It is til be conpretiensi ve, fair, successful* and etfective, will 
t«*).;ire studf» under standing! cooperattont effort, and time on the part 
o! stud^ntfti t.iiultv, dUd idnini strators. It should also be recognized 
tet ue undertaking the ett'ort, that no evaluation system can operate 
ettectivt'Iv beyond the fairness and thoughtfulness of the persons who 
r.ak«* the rati.Mgs. Moreover, only through a comprehensive and flexible 
svsten, adnlnistered by persons with appropriate sensitivity, judgment, 
fairness, and understanding, can the unique strengths and weaknesses and 
thf> special contributions of given faculty members be appror riately 
recognized. 

It is also important to consider that evaluation of teacher effective- 
ness; .an and should be based, not only upon student ratings of teachers, 
but also upon other sources and types of data. Among the types of data 
which night be presented under certain circumstances as evidence of teach- 
ing t»t'fec t iveness w^re: 

I. F.vidence of student achievement, e.g. based upon pre«* and post- 
scores on specially designed or selected achievement tests 
(see Appendix A); or based upon representative evidence of 
achievenent by students, e.g. short stories, art works, term 
papers, reports, computer programs, etc. 

Evidence of course development, e.g. based upon submitted 
documents or samples of learning activity packages, student 
handbooks or manuals, media presentations, written assign- 
ments, computer exercises, specified objectives, etc. 

3. Written and signed testaments from students, collragues, 
administrators, etc. documenting special teaching skills, 
efforts, achievements, etc. 

4. Written reports by qualified evaluators (e.g. on a depart- 
mental evaluation committee) who might observe performance 
in the classroom and/or conduct interviews concerning course 
objectives, methods, etc. 

5. A written statement by an individual instructor concerning 
his teaching objectives, methods, course development, 
aecompl ishment s, etc. 

^. Research which pertains directly to teaching and course 
development at NCCU, e.g. a study reporting results of a 
teaching innovation or a report of a project in which 
students participated materially. 

In assessing a teacher's effectiveness, consideration must also be 
t*iven to various intrinsic and exfirinsic factors which can affect teach- 

pertornan e. Anong these factors are: teaching load — number of 
students, number of preparations, number of contact hours, etc.; teach- 
ing experience and qual i t i cat ions; nature of the student population in 
terns ot ability, motivation, etc.; level of students — lower division, 
upper division, graduate; level of course — introductory or advanced; 
otliei responsibilities and commitmenct of the instructor e.g. administrati%*e 
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or sHhvt n.ui-trMrhing duties, as^ignnfiit s whu h take iiistrurlor oM-ianpus; 
extent ol previous develi.pneiit .>t . .>nr<t» n.iterials (v.^. new Ci>urse vs 
eslaMi>hea wOurs>e)# etv . 

With consideration given tt> the total piiiMe*, of evaluating tea« her 
et tectiveness, particularly to the poiiUs raised alu^ve, the tollowiiig 
specific procedures for i)l>taining and using '.tudent ratings ol teachers 
are suggested as. alternatives, fron which one or more appropriate instru- 
nents and a procedure might l^e selected and/or adapted. The alternatives 
include student rating procedures and a procedure tor ratings h\ qualified 
observers. 

This report iloes not include instruments or procedures for evaluation 
ot non-teaching activities. Instruments and pro^ edures lor faculty self 
report*: of annual activities and for overall appraisal ot tacultv perform- 
ance have been im^luded in other reports. 
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IMPLiMlNTINi; RLSi>URCE REQUIREMENTS PREDICTION MODEL 1.6 (RRPM 1.6) 



James Nichols 
Concord College, Athens, West Virginia 



Robert E* Reiman 
Appalachian State University 



A workshop concerning implementation of RRPM 1.6 was conducted for 
the participants in the 1973 NCAIR Forum, The workshop was premised 
upon the assumpt ioris that implementation of RRPM 1,6 was viewed as a 
desirable action by senior administrators and that the personnel in 
attenddn:e had been directed to implement the model as quickly as possible. 
Having set the stage for a "nuts and bolts" level presentation, comments 
were directed at: (a) determination of a general sequence of steps for 
the technical implementation of RRPM 1.6; (b) discussion of various de« 
cisions required regarding structuring and data elements in the model; 
(c) completion of necessary coding sheets. 

The following steps were explained as a general sequence for the 
technical implementation of RRPM 1.6: (1) Establishment of the institu- 
tional framework; (2) Production of Induced Course Load Matrix data and 
c^egree program enrollments; (3) Calculation of teaching data per discipline 
level; (4) Calculation of faculty data per discipline; (S) Determination 
oi support staff data per discipline; (6) Allocation of other direct cost 
line itc^iis to disciplines; (7) Identification of non-instructional cost 
centers. 

In discussion of these ge^.eral steps implementing RRPM 1.6, decision 
areas concerning: (a) the number of fields of study to be identified; 
(b) the level of organizational structure to which the model would be 
applied (disciplines/departments/divisions/colleges); (c) whether to use 
FT!- or head*count degree program enrollments; (d) to what extent to go in 
allocating other direct cost items to instruction; (e) other areas for 
decisions concerning implementation of the model. 

Dr. Nichols discussed in some detail a relatively simplified manual 
meatis for determining teaching data per discipline level and faculty data 
per discipliuf which were identified as major areas of difficulty in 
implementing RRPM l.o in an analytic mode. 

In summary, it was indicated that the problems c6nnected with ii^le- 
menting RRPM 1.6 in either an analytic or projective mode were substantive. 
However, these p'^blems when recognized and dealt with in an organized 
manner were described as being relatively easy to overcome in a short 
period of *ime. 
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Nv>Km (\\IU)IINA ASSiriATION H)R INSTI rUTI<>NAI. iU SI AKrif 



BUSINLSS SUSSION. i97^ ANhOJAL MliiTINi; 



Ml^aJ^us 



Pie nteting was called to order by l»r* Robert I, Kfin«tii .it 11:40 a.m. 
on November I, l*)7i as the closing session ot tho 197 4 annual niM*ting in 
i'harlotte, North Carolina. Dr. Reiman expressrd gratification at the 
interest indicated by the attendance and general attitude of xhv lirst 
annual meetmi^. He stated that he hoped that the Assoi iation wonld con- 
tinue to receive active support by its part u; ipaiUs. 

Mr. Robert Ussery presented the '974 Membership Report. Me reported 
a total ot n active nenbers, 55 individual, and In institutional, and 
that 94% of tne active members were charter menl)ers. 

i/r. Aaron Hyatt presented the Budget Report, a copy of which is 
at tachtfd. 

Dr. r.dwin Chapman, i'hairmm of the Nominating Committee prestMited the 
Nominating c'onnittee Report. Placed in romination bv the Committee were: 



'^r. Reman i. cepied that report and noninations and thanked thf ionmittee 
for its woik. The tloor was opened for turtht'r nominations to. th<' first 
tour ot 'ices. There were none. A motion was made, seconded, and passed 
to elee I the tirst four « andidates by acrlain. t'liarU's Urown was tlu'ii 
nominated t ron tloor li^r nor.bt r-at-large. \ vole wa^ taken whii li rp*;ulted 
m th.e fle.tujti of Id NVl ,»mi and hailes Drown a. tlu- Mrmber .it-lar>;«'. 



Robert Reiman 
Gloria Srott 
Robert Usserv 
Aaron Hvatt 
Stover Punagan 
Id Nelsen 
Soman b'hl 



Menber-ai-large 
Menber-at-l.irge 
Member-at-large 



Treasurer 



President 



Vice-President 
Sfc re tary 
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The 1^"*4 utficetb are: 



Robert Keimdii 
Gloria Srott 
Robert Ussery 
Aaron Hyatt 



Secretary 
Treasurer 



President 
Vice-President 



Charles Brown 
Ed Nelsen 



Member«at«large 
Hember«at-large 



Under other business. Dr. Reiman stated that he would direct a survey 
of the membership to elicit preferences concerning future meeting foraats 
and topics, and to request an evaluation of the annual meeting from those 
who attended. 

Dr. Ben Romine suggested a survey of Institutional Research staffing 
patterns and an inventory of Institutional Research activities. Dr. Reinan 
said that this had merit and would be considered. 

Mr. Charles Brown suggested that alternate categories of membership 
be established. Dr. Ri»iman directed that this be considered by the member* 
ship committee and that recommendations be made to the executive conittee. 

The meeting was adjourned at 12:30 p.m. 



Robert N. Ussery 
Secretary 
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FINANcriAL STATtMENT l-OR NCAIR - November I, 197J 



STATLMKNT OF IM/OMI' 



February 21, 1Q73 
February 28 
March 12 
April 2 
April 2"^ 
August 3 
September 20 
September 2^ 
September 28 
October 9 
^^ctober lo 
October 22 



Conference Income 



175.00 
I "0.00 
115.00 
70.00 
95.00 
35.00 
5.00 
10.00 
55.00 
70.00 
80.00 
45.00 



$ 925.00 
205.00 
% 1.190.00 



April 13, 19: 
August 4 
August 10 
September 20 

Octol er 31 



STATEMEhrr OF EXPlilWITURtS 

Printing (Letter Heads) 
Printing & Postage (lorms) 
Printing (Proc»*cdings) 
Printing (Charter Menbership 

Forms) 
I-.niertainment 



22.05 
14«04 
322.00 

25.50 
30.00 



$ 413.59 



BALANCE RENWINIV*; 



$ 77f).41 



Submitted by 



Aaron Hyiitt 
Treasurer 
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